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ABSTRACT 



A description is given of how edges of prismatic objects appear 
through a television camera serving as visual input to a computer. 
Two types of edge-finding predicates are proposed and canpared, 
one linear in intensity, the other non-linear. A statistical 
analysis of both is carried out, assuming input data distorted 
by a Gaussian noise. Both predicates have been implemented as 
edge-verifying procedures, i.e. procedures aiming at high sensi- 
tivity and limited to looking for edges when approximate location 
and direction are given. Both procedures have been tried on 
actual scenes. Of the two procedures the non-linear one emerged 
as a satisfactory solution to line-verification because it performs 
well in spite of surface irregularities. 
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INTRODUCTION 



The task of computer vision if defined as follows: 

A television camera, the vldissector, scans a visual 
scene consisting of three-dimensional objects. The 
camera is connected to a computer, and an array of numbers 
representing the light intensity distribution is entered 
Into the memory of the machine* Our goal Is, using this 
information* to separate and identify the objects in the 
scene. 

That visual perception can be accomplished by reducing the 
originally multidimensional information to the set of discontinuity 
lines, is amply confirmed by our ease at recognizing objects in 
line-drawings . There are many soft-curved objects in our world; but 
even then, the outline together with a few lines along the maximal 
curvatures, constitute a good representation of the object, for 
recognition purposes. It is thus natural that computer vision should 
start with Line detection* 

The difficulty of boundary detection lies in part in the 
nature of our detector, which provides with a set of set of 
digitized, noisv light intensities at discrete locations. 



But the difficulty lies above all in discriminating surface structure 
from actual edges. In addition ve must proceed in a reasonable amount 
of computing tine* 

The work in this thesis consists of three main parts; 

1) an investigation of the nature of the world as seen through 
our input devices. 

2) the definition of a boundary detection procedure proficient in 
the following situation: presence of a Gaussian detector noise and 
surfaces of uniform texture except for the presence of rare defects 
of small diameter* 

3) Finally the detection method has been concretely worked out In o 
"line verifying program"; i.e. we assume that we know approximately 
the location and direction of the edge and we aim at a very high 
sensitivity, the price of which is reflected in a computing time 
too large for general purpose use. This defines a partial problem 

of line detection! justified by the overall conception of the vision 
system at Project MAC; i.e. our program is to be used only locally, 
in critical cases of "elusive" edges, under call of a higher level 
procedure, which looks for evidence that in some area, a less sensitive 
but faster procedure has missed a line. 



HISTORY OF THE PROBLEM 



In the beginnings of computer vision, the following local predi- 
cate was used; 

A point is likely to belong to a boundary if the following 
condition is fulfilled: any one or both of the differences 
between the light intensity at it and at its horizontal and 
vertical neighbors are greater than a given threshold, 
(see Roberts»1963; his predicate is a variant of the above,) 
However this simple idea soon proved itself unsuff iclent. It is 
successful in the very limited case of surfaces of excellent homo- 
geneity and with a high contrast between the regions limiting the 
edge. Otherwise any choice of value for the threshold will either 
give as boundary points any surface irregularity, or report as uni- 
form areas where an edge lies. 

'Coincidences Predicates 1 (T.Binford) constitute a fair improve- 
ment. Instead of a single large intensity difference one requires the 
occurrence of a pair of them, in parallel; i*c. if I, denotes the 

light intensity st the lattice point (i,j)> the differences 

"i.j - I i + i, j > and <1 i, j+ i - Wi J " u,t be boch 1-rge 

and iLt Lhfi fla ffl q sign < or alternatively (I. - - I. . . ) and 

(I t - 1 . 411) )• The actual predicate is a somewhat more 
i+t » j i+i 1 j+i 

complex elaboration, and improvement of the same principle. 
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This criterion will clearly be harsher on random perturbations 
than the preceding one. But true boundary points will paas through 
because an actual line 'extends along its own direction 1 . 

With the additional noise filtration gained through the kind 
of line-fitting method which attempts to find an accumulation 
of boundary points along a line, this constitutes a reasonably good 
technique for general purpose use; it is economical in time and 
discriminates somewhat against surface defects. But it is limited 
in sensitivity (it uses for its decision the evidence of a 
small set of points, thus preventing the statistical law of large 
numbers to play very much in our favor by making us converge toward 
the underlying noiseless distribution). At least on some small subparts 
of the image* we need to do better. 

In ' An operator which locates edges in digitized pictures ' 
(Hueckcl. 1969), an 'edge operator 1 Is proposed, which accepts all 
brightness values within a small disc-shaped subarca of the picture; 
it then applies to them a low-pass filter which singles out 8 low- 
order Fourier components ( wavelengths of order the diameter of the 
disc); some of the white noise, whose spatial frequency is higher is 
thus ellminatedj but also some useful information. It will then attempt 
to fit to the transformed distribution an Ideal noiseless brightness 
step. An elegant mathematical solution yields the location and ampli- 
tude of the best fitting step. If the amplitude Is large enough* it 
is Inferred that an edge effectively passes over the disc. 



The operator appears to be reasonably fast and to have a fine 
resolution; although the paper does not include any discussion of the 
sensitivity, our evaluation of its lower Unit showed that it was not 
sensitive enough for our needs. It does not provide for edges yielding 
a light intensity surface other than a step separating two horizontal 
planes; we will see that often this is not sufficient. 

Griffith {P.H.D. thesis: in preparation) is working toward a 
"Theory of the opticus! use of intenoity information in the detection 
of lines in the visual field". Optimality is defined under the folio* 
wing set of conditions: 

(1) The 'scanning pattern' t namely the set of points at which 
brightness measurements are taken Is fixed; I.e. rid additiArial 
information about the picture can be obtained in the course of the 
procedure* 

(ii) The noise is Gaussian- Surface defects are not taken in 
account. 

(Hi) Hie procedure is uniform with respect to position and 

orientation. 

(iv) The a-priori probabilities of the presence of lines 

are known. 

We do a somewhat more realistic treatment but a theoretical approach 

with these simplifying assumptions is of great interest. 
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PRELIMINARY STUDIES 
WHAT THE WORLD LOOKS LIKE THROUGH OUR INPUT DEVICES 

1 Thr light hflmm ffljjj 

The interface between vidisaector and computer yields numbers which are 
logarithms of the light intensity. Calibration of tho measure apparatus 
has given the following result: 

Adding 96 to the logarithmic measure corresponds to division by a 
factor of 2 of the- actual light intensity. 
We will in the rest of this thesis call these units vidloa units o r v.u. 

Z Pa mia 

a) ^j^jgyj^e^ can be traced to A phenomena, 
i) Photon nojfig 

Measuring the light intensity is done by measuring the time taken for a fixed 
number N of photons to hit a photosensitive device. The light intensity, I, It 
Inversely proportional to that time. The number of photons arriving during 
successive equal intervals of time t, show a Poisson distribution, which for 
large numbers* can be approximated by a normal distribution of mean, say N, 
and standard deviation Js - JN. With a good approximations if for a given in* 
tensity H photons arrive in a time t gn Average ■ then if Jt is the deviation 

ontl * c: It, £h. 



11. LB. .L 
t N {# 



As N is kept constant through all our m*aaurementa t It remains constant 

t 
whatever the intensity and so is £i m £k ■ Thus, if L - Log I, S"l U a 

I t 

constant; i.e. expressed in log arithmic units, the photon noise remains the 

same for any intensity level. 
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it) Jtei.se ;ui .Uifi-glec.LC9iilc.fi 

Very little is known about it. In any case it cannot bo sepa- 
rated from the above source of noise. 

Hi) Simla of th* 1**p 

The aun gun lamp which wc used had a large amount o£ 120 cycle 
noise, o£ which we became aware only recently, so that all the expc- 
riments described in the thesis were carried out without any protec- 
tion against it. We now use photocathode reference for the measure- 
ments i.e. normalize by the average photocathode illumination. Small 
lamps are particularly noisy because they have small filaments. We 
are about to try D.C* supplies for the lamps. 

iv) Inhomoaeneitv of the photocathode 

The sensitivity of the measurements by the vidissector varies 
from one point of Its field to another* 



b) A measurement of the effective standard deviati 



i? ii 



We want a measure of the noise which accounts for alt the above 
factors. As we will sec, our detection functions always involve a 
comparison of nearby values of the intensity. Thus a first approxi- 
mation to the thresholds to use for testing the presence of edges, 
is based on a value of the standard deviation accounting for the 
spatial lahomogenelty of the sensitivity of the vidissector. 

After having defocusscd in order to have a surface with good 
homogeneity* wc scanned a sheet of white paper, first horizontally 
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and then vertically, and at each point we took the following measu- 
rement: the difference between the average of 15 brightness values 
on a segment centered around the point and the value at the point* 

The sum ot the squares of these was averaged over the whole 
screen and the square root of the result Is the required standard 
deviation. We found a value 

fl - 1.2 v.u. 



As a guide for fixing thresholds, we worked according to the 
approximation that the overall noise was Gaussian. All the errors 
can be expected to be proportional to the intensity and therefore 
the logarithmic error is constant. 

1 Surface structure of the objects. 

Wc have not dealt with texture but only with sparse surface 
irregularities of small diameter i.e. covering around 1% of the 
surfaces. In fact we were successful with surfaces considerably 
worse than we were expecting to use; several scenes (see figures 
27,28 and 29 . ) contain objects which were chosen to bt very 
bad; they showed a linear wood texture and a pebbly texture of end- 
grain. 
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A Light intensity distribution 



Intensity profiles taken along straight lines on planes showed much 
larger gradient* than we expected. The phenomenon waa investigated, 
both theoretically and experimentally. 

The intensity varies essentially because the light source Induces 
a non-uniform intensity on the object* As Appendix I shows, with a loga- 
rithmic measure of the intensity, the gradient of the reflected light 
at the object and the gradient at the image are the same, to a second 
order approximation. Thus we will now conaider the 

(i) Variation of the light intensity on a plane in presence of a point 

light source. 




figure 1 



IN is normal to the plane 
which Intersects the plane of 
figure according to NMx. We want 

to compute ^ L, ■ L- being 

*> x 
the light intensity at M. (It is 

along the direction Nx that the 

gradient is maximum). 



E being the energy emitted the 



whole An solid angle. 



-M - 1 
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The gradient shows a maximum for on angle of 45 between the light rays 
and the plane of the object. 

The experimental curves currently show gradients 4 times as Urge as 
the gradient computed according to the above formula, for the same relati* 
ve position of the source and the object plane. Thus some other pheno- 
mena must interfere. 

The two main causes seem to be that the lamps we use are far from 
being point light sources* and that the reflectivity of the surfaces 
varies with the angle of incidence of the light rays. 

(ii) Experimental exploration of the liaht intensity on a plane surface 

We used sheets of white and uniform paper and took intensity cross- 
sections in various locations and directions, We found the following 
results: 

I) The most important factor 
is ,the angular dependence of the lam P 

lamp radiation. Instead of a conti* Vir 

\ \ 

4 maximum at C where the axis of the / N G W 



nuous decrease of che intensity from 
N away along NM (figure 2 ), we get 



lamp intersects the plane of the sheet- fixur* 2 



2) Extreme values of the gradient are at points where the cos 6 

2 
effect is maximum And contribute to the gradient vith the 

same sign as the angular dependance o£ the lamp- They are of the 

order of: 



10 vidlog-units / 



cm 



Because of defocussing the inten- 
sity profiles across a perfect edge 
(figure 3a) will look as in 3b. 
b is the convolution of a step and 
a circle (sec figure 5 too). 

We vill evaluate the extent of ab 
for usual deviations from perfect 
focus * 



*) 



n 




aperture 



plane of 
object . perfect focus 

4 




figure A 

Let us suppose an edge normal to the sheet of paper in 0< Light rays 
which enter the aperture and issue from points on the circle of diameter 
00 (circle of confusion) converge toward the image of E (respectively 
0a and A). 



* fc 
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Light rays apparently issued from any point ? in the plane of 
best focus, converge after crossing the optical system, to a point 
imago of P. If P la between A and B, the light rays will cone from 
both sides of the edge. If P La outside AB, Its luge will be the 
point of convergence of Light rays coming from the same aide of the 
edge. 

Thus the width of transition ia the width of the image of 
AB - o through the system. We have: 

a being the diameter of the aperture and ? the relative error in 
position with respect to perfect focus. 

If a' ia the distance aperture-image for a distance s aperture* 

object; 

1+1.1 * : focal distance 

s a' f 

and the corresponding ratio lmage-ai£e/obJect~slzc is £* ■ Thus o 

a 
image of $ ia: 

3 



r* jl^ 7 



As s is relatively large, the image of J ia practically in the 
focal plane and f * s*. Thus; 

We can evaluate on upper limit of d . The vidissector characteristics 

are; 

f - 10" 

a - from 2" down. 

We will focus at worst to 2" at 3 feet. Thus: 
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r'_ f to . i . t ) . g wm 

36 3* > 



The diameter of the photocathode is 3 • The ratio of the maximal 
width of a line to the photocathode diameter is; 



?•*- 



90 

The resolution of the photocathode being about 1000 points, J will 
be at moat 11 grid-points. 

With B. Horn focussing program (B- Horn 1968) . focus can be done 
to 1cm at 3 feet. Thus P becomes: 

and o ■ 3 mm or 4 grid'-points. 
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6 Results. Characteriatlc aspect r. aj od^ cf . 



Wr found mainly 3 different shapes of cross-sections normal to 
edges : 

(I) Steps (figure 6a), — ■■ I 

(II) Roofs (figure 6b), On each side of the edge the profiles have 
different constant slopes, Usually a small effect* ,,*-—*****" ^*^-**^ 
(ill) Edge-effects (figure 7), On the edge is a small bump of the in* 
tensity surface. /\ 

These three characters may be combined as in figure 8. 
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Cljjurc 




Eipurc 6b 
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figure 7 




figure fi 
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SOME GEKEKAL CONSIDERATIONS ON DETECTION PROCEDURES 



The number of possible schemes for boundary detection Is very 
large* However they all have in cocoon that noise discrimination is 
obtained,in part, by integrating tome function of the light inten- 
sities over some subset of the plane, (a ono-dimensional (segment) 
or tvo-diraenaional (rectangle or circle) neighborhood). 

Around each point of the plane is centered such a neighbor- 
hood Jt? » the Intensity at any point P of(7gcan be written as the sum 
of a pure signal S(P) and a noise N(P). If we then apply a trans- 
form T to the intensity surface, noise discrimination will occur 
under the assumption that: 

[ [l S(P) + H(P)1 tends toward / t[s<P)1 

when the area (or length) of Jfe tends to infinity; I.e. the integral 
of the transform of the combined signal tends toward the integral 
of the transform of the pure signal. 

This is true for the transformations we have considered under 
the conditions that the noise at 'every point is Gaussian* has mean 
zero and a constant standard deviation; and provided that noise and 
signal are uncorrelated. 

The transform must be such that the integral reflects the pre- 
sence of a discontinuity of the pure signal within the domain of 
integration $Q , a discontinuity characteristic of rectilinear edges 
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The transform can bo linear or non-Linear in intensity. In the 
rest of the thesis we will examine two methods; one Linear and one 
strongly non-linear. We adopted the Utter. It uses cutoffs on the 
result of processing of the intensity surface by some differential 
operator; consequently the original brightness surface is transformed 
into a 3-level surface, a drastic reduction of the original informa- 
tion. As a result, it cannot be optimally sensitive and linear 
predicates behave better in this respect* But it has one important 
advantage a name Ly : 

Contribution of surface defects to the integral over a 
a basic neighborhood is according to their extoqt not 
their ampLLtude. This gives to the method a good discri- 
mination against structural noise- 
In linear methods, surface defects bias the computation proportionally 
to their extent and amplitude * which is often very large* This Is 
particularly unfit for a line-verifier system where high sensitivity 
must be obtained by integration over a relatively large neighborhood; 
thus the number of points in the plane whose surrounding neighborhood 
includes the defect is large and the error is propagated far away 
from the defect itself. Wo have kept here the analysis of a linear 
method, because it sheds Light on the properties of real edges and 
gives some idea of the theoretical sensitivity limits. 

Up to now we have been speaking of the local part of the proce- 
dure. Detection methods will then differ by: 

(i) What the local stage returns for information. 
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(11) Hov this local information is put together to reach a 
global answer to the detection question, i.e. the global set of lines. 

Tlie local processing may return likely "edge-points". Then, at the 
next stage, vc will look for an accumulation of edge-points along some 
direction. 

Or it may return "edge-vectors", i.e. vectors tangent to the edges , 
Then the vectors vill string according to colllnearity. 

Or the Information carried along to the global process may be 
still more detailed; for example the edge-vectors may be accompanied 
by information about the type and amplitude of the discontinuity they 
reveal. We vill then string together only vectors o£ the same type 
and amplitude. 

Vc have listed these methods in an order corresponding to an 
increased noise filtration by the local-to-global process. The amount 
of noise which can then be allowed to pas* through the first noise 
filtering, (the local predicate) is correspondingly greater, i.e. 
fainter edges can pass through and sensitivity improves. But the neces- 
sary amount of work increases. 

The method we have opted for in the line-verifier returns from 
the local stage with an edge-vector accompanied by the type and the 
"sign" of the discontinuity, the sign being defined according to the 
following : 
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Positive 



Negative 



Stop 



Roof 



Edge-effect 



V 



A 



It did not soom meaningful here to introduce several levels of amplitude 
because we are looking only for very snill signals anyway. 



With the following chapter we will start examining some linear 
transforms; we will first see how they act on one dimension* i.e. 
along a profile normal to the edge. Then we will briefly describe a 
global method which we tried and how it failed. The last chapter 
will be devoted to the non-linear method. 
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LINEAR DETECTION PROCEDURES 

X One-dlmcnslonal linear t^an^on^ 

lii Function Fl. First differences Integrntrd 

The most usual Intensity profile across on edge being roughly 
a step, let us consider the following function* Fl: 

At each point of the profile, we compute the difference 
between the average intensity after and before the point; 
both averages are taken over a given length 24 (26 points) 



Let L(X) be the intensity profile; 



L(X) 



£ [LfX*;)- U(X-t)] 



This amounts to taking the first 
differences with an interval 24: 
D1(X>* U(X+ * J - LU-A) 
and averaging them over 2 A ; 



D1(X) 



-i 



u 



Pitt) * A 




* F) (XI 

Figure 9 shows L, Dl and Fl for an 

Ideal noiseless step. 

figure 9 

We will now discuss the sensitivity of detection on a single 
intensity profile. 
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(i) SiMit-Uivitv iiniii imparl by random noise 



Lot us consider a flat intensity distribution with a random 
Gaussian noise superimposed, of standard deviation &L. 

Fl, linear function of 4^ independant variable* Is normally distributed 
with average and standard deviation; 

5Fi a jfi XL- Ik 

A step h which we can detect must be such that: 

the value of Fl on an edge with step h^iPl, the noise. 

Thus: 

(1) h >> ii. 



(ii) 



IE 



icsed bv systematic effects 



a) Constant slow 
In order to discriminate an edge from a constant slow slope, 
the value of Fl on an edge must be larger than its value for the 
maximal slow slopes encountered. 
Let a be the slope. Then; 

A step h can be safely detected only if: 
(2) h>;> 2*a 




optimal value o£ ^ 



The maximal values of a encountered are of the order of 10 v.u./cm. 
To improve the sensitivity A should be increased according to (1) 



and decreased according to (2). Thus the optimal value occurs for: 



i A « = 



28 



A* = 



ax 



At a distance of 3 feet, 1 cm is Imaged Into 40 grld-pointa, and with 
a noiae flL » 1.2 v.u. ; 

* A optimal - * points 
With the normal distribution assumption, if we then put a cutoff on 
FL at 2.6 times JFl f i.e. if ve predicate: 

there is an edge ++ Fl > 2.6 $>1 
we will reduce the probability of error in the absence ££ in edae 
to 1%. Detection will be successful at 50%for an edge h yielding 
a value of Fl equal to the cutoff, i.e.: 



2.6 



JL 



ft 

h - 1-6 v.u. 



c) Defocufising 
Let us approximate the smeared intensity 
profile by straight lines as shown in 
figure 11 . Let S be the width of the edge. 
As we have aeen a may currently be of 
the order of 8 points. For 2£* 4, 
F1(X) will have a peak value of h/2 
instead of h. If we use the same 
cutoff on Fl as above, 50% detection 
will occur only for a step: 

h - 3.2 v.u. 




Dl(X) 




F1(X) 




figure 11 
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The sensitivity is clearly unsatisfactory, and whatever the ttlohal 
decision procedure, it cannoc be conspicuously improved because of the 
presence of constant gradients on planes* 

One is therefore lead" to think of criteria such as: there must be 
a local maximum of large amplitude of the function Fl on the considered 
profile* This amounts to considering differential operators of higher 
order, using second and third differences; these are the transforms 
which we will now consider* 



1*2 function Ei 

Let L<X) be an intensity profile and: 
D2(X) = -2L(X) + L(X+e> + L(X -A) 



L(X> 



?h 



F3(X) = -U 

A 



2>2(X+i) - £D2(X-i) 



D2(X) 



i i ; ^ 

A 



u 



l»1 it1 

D2 is the second differences with 

an Interval A. F3 is the difference 

between the mean of D2{X) over A 

points after X and over ^points 

before X* 

Figure 12 shows D2(X) snd F3 (X) 

for an idealized step-type edge. figure 12 

Our reason for introducing F3 and not simply tsking s function which 
averages D2 over an interval is thst we prefer to deal with a signal 
which is large rather than zero on the edge. 
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(i) Sensitivity limit impend by random nni?r. 

Vith random noise, D2 has mean zero and variance: 

( JD2) 2 = (2SU 2 + IL 2 +SL 2 

SD2 ■ Jo"£l 

Thus : rr r i ^ 

5f3- x/Tfl - jg 5L - 5 CEIL 

F3 on the edge equals 2h. 

Therefore a reliably detectable atep h must verify* 

2h >> 2[T J" L 



Jiii Systematic effects 



a) F3 is obviously zero for constant gradients* F3 is zero too for 
any intensity curve vhich may be approximated by a parabola. So that 
the angular dependance of the light source which is approximately 
parabolic* give* no contribution. 

b) The effect of defocuaalng depends on the relative values of the 
width I of the line and of 4. The limitation on A being much less tight 
because we dont suffer from constant gradients, we can assume that 

2 A » o and that defocussing does not affect us. 

(ill) ttflJBl gf A 

The greater £ the better the sensitivity. Our limitation will then 
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come from: 

a) The physical size of the object 

b) Hie light intensity distribution on a plane has to be 
possibly approximated by a second degree polynomial. 

Now to compute aa& value of F3 at a point X, we need 4i points, 2*4 on 
each aide of X- Thus 4A must not exceed, say 1/5 of the side of a 
current cube- The side of a current cube being about 1/5 of the scene 
we must have; 



^ _ , * 10 points 
optimal 



Then, if we put a cutoff on F3 corresponding to 2.6JF3, we guarantee 
an error < 1% on a flat distribution, and the corresponding step h, 
for which detection will occur with m probability of 50^ is: 



h - 2 - 6 ^ 



Jl 



h - Q.53 v.u. 



1.3 Function F2 

When the edge does not appear as a step, 
but as an edge-effect or a roof, the function 
F3 is not effective. We must instead use 
something like the integral of the second 
differences, which expresses the radius of 
curvature* Let : 
D2(X) - -2L(X) + L(X+A) + L(X-oJ 




F2(X) 



figure 13 
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02 (X) , I_£o2(X+i) 

P2 is the average of the second differences over 2 4* Figure shows 

the resulting curve for a symmetric roof sith slopes a and -a. 

Expectation of P2 for random noise 

With pure random noise* F2 has mean zero and standard deviation; 



; p2= jST »* . tf SL 



2 A \fiA 

When dealing with an edge-effect, ^ should he of the order of 3 points. 
With a roof, something around 10 points is a reasonable value ford. 

In the case of sn edge-effect, the width of the bump is of the 
order of 3 to 10 points, under current conditions; by a one-dimensional 
processing of a cross-section, we will discriminate against Irregula- 
rities less than 3 points wide; therefore we will keep most structure 
defects, which arc not distinguishable from an edge-effect. Our global 
decision procedure must then rely essentially on the comparison of 
parrallel cross-sections. 
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2 A simple linear global process 



We tried these one-dimensional linear transforms within a conple- 
tely linear decision scheme. 

To be concrete we will assume that we are dealing with an edge 
of the step type, and that we apply to the intensity cross-sections 
the function P3. « 

Ve want to know whether an edge lies / 

between Pi ± dx and P2 1 dx. Ve consider / 

15 equidistant profiles between PI and P2 / fl } 

and sum the values of F3 along a number figure 14 
of lines joining a point of PI £ dx to a point of P2 £ dx. 
Ve look for the largest of those sums and decide in favor of an edge 
when it is greater than some prefixed threshold. 

AD CYflluaUgn of tjie. 5.ensj.tivltv.linit: 

The standard deviation on a sum S of 15 independant values 

of F3 is: 

AS - V15 JF3 - 2-0 v-u- 

A cutoff at 2.6 is as we usually do, gives for the seep detectable at 

50 ^ : 15* 2 h - 2.6JS 

h - 0-15 v.u. 
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This was programmed and tried. It was very good at finding very 
faint edges but the rate of errors on faces was very large* due to 
surface defects* 
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A NON-LINEAR DETECTION PROCEDURE 



As 1:51:3 1, we wiLL describe the method by distinguishing two stages 
of processing* the local and the global. 

l) The LflflAl aiidiam 

Wc make a local decision based not on a single profile> but on a 
small number of parrallcl adjacent profiles. In other words, we consider 
a narrow strip perpendicular to the expected direction of the edge, and 
the local decision process returns possible edge-sepments which cross It 
almost vertically ((or brevity we will always say vertical for the expec- 
ted direction of the edge although it can be any direction along which 
we choose to look). 



We do this by computing a certain function 
F of the intensities within a basic 
neighborhood which is a small elon- 
gated rectangle which we slide along 
the strip, ta yg q l ocal maxim a of this 
function F indicate possible locations 
of almost vertical edge-segments. 

For a step, the function F is 
defined as follows: 




figure 15 
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we compute the second difference* along every horizontal profile in the 

strip with an interval £• Figure 16 recalls the shape of the curves- Thus, 
if wc put a two-sided cutoff on the 



profile 



second differences (and assuming the 
atep high enough)* the distribution 
of cutoff points shows two A-points 
wide adjacent rectangles, one with 
all values below the negative cutoff, 
and the other with all values above 
the positive cutoff (figure 16). 



The function P _ ia then coapu- 



second 
differences 
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figure 16 
ted over a neighborhood 2i, and equals the difference , between: 

R - <# 'positive' points - # 'negative' points) in the right half of 

the neighborhood and: 

L ■ (# 'positive' points - # 'negative* points) in the l, q f t half. 

This function shows a sharp 
extremum on the edge (figure 17), 



The function F x has the 
step 

following advantages: 



(i) The use of a two-diraensionai 
basis neighborhood increases the 
possible number of points entering 
in its computation! thus improving 
the noise discrimination. 




figure 17 
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(It) Ic accounts for the directional property of the edge, i.e. the 
repetition of some accident in the 'vertical 1 direction. 

(til) The weight of a surface defect is equal to the number of points 
it covers, i.e. taxes us minimally. 

One difficulty la the "wings" shape of F I the relevant extremum 

is framed by two 'parasite' extrcma of amplitude half that at the edge- 
Thus some precaution must bo taken to eliminate the 'satellites'- Our 
first idea was to compute the function S which is the jum of the two 
terms involved in computing ^ » i.e. S is; 

( p positive points * ft negative points) in the fl gj| basis 

neighborhood. 

5 - L + R (notation as in the definition of F ) 

S is plotted below F : as it is zero on the edge but Large on the 

step 

satellites, it offers a possibility of discrimination. 

As we will see, in the case of the line-verifier, this proved an 
unsatisfactory solution and had to be completed by some measure at the 
global level. 

Remarks : 1) The heLght of the strip should be big enough to allow 

the 'directional property' of the edge to play its role; but small 
enough, so that for the given angular uncertainty of the edge which we 
allow, the horizontal coordinate of the edge varies negligibly while 
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crossing the strip (i.e. at most 1 grid-point). 

2) In actuality, when computing F fi • we separate 
left and right half of the neighborhood by a narrow vertical corridor, 3 or 
4 points wide, to allow for imperfect focus. 

3) The second differences are in fact the folio* 

wing function: $ 

D2(X) - L(X) - L(X+A) - L(X+4+l) + L(X+2a+l) 

i.e. instead of taking twice the canter value as in the usual second 

differences D2, we add the values at two nearby points. Then; 

($D2) 2 - 4 (ID 2 

Xd2 ■ 2jL instead of J&[l for fr>2. 

i 
D2 is less noisy. 



I) Statistical properties of the local function F *„ 



We define the probability of local detection as the probability that 

the value of F at a given edge be greater than some prefixed threshold 

step 

9 . As we will see, the additional condition which ve have introduced 

step 
to eliminate the satellite extreme of F keeps the actual probability 

of local detection equal to the one in thle definition. 



We will compute "detection characteristic curves" which represent the 
probability of local detection as a function of the signal, considering 
Gauss ian US.?J^£ only. This BpprexlAia t i ° n will p.ivr u : . a starting point 
for fixing the parameters. 
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The parameter* which hear on the probabilities of detection arc as 
follows: the size of tho basic rectangular neighborhood, the cutoff 
value for the aecond differences, and the threshold for the function 
F • The computations constitute a simple combinatorial problem 

(see Appendix II) whose results follow: 

1) Figure 18 (next page) shows the detection characteristics for various 
sizes of the neighborhood, expressed as the number of grid-points It 
contains * 

To allow comparison, the same cutoff on the second differences 
has been used (i«e* zero) for all the curves , and the threshold on 
F has been fixed to a value giving a probability of error of 1% 

in the absence of an edge (signal = 0). (When made possible by the 
available parameters, this ia the quantity we will keep constant through 
all characteristic curves; as it is more relevant for performance compa- 
risons). The signal is measured in number of light intensity standard 
deviations. 

The sensitivity of course improves with the number H of grid-points. 
A measure of the sensitivity is the signal for which detection is 50^£ 
successful. Figure 19 plots this quantity as a function of N; sensitivity 
improves approximately as J5. 

Geometric considerations limit the sire of the neighborhood. For the 
line-verifier, 70 grid-points, a rectangle of length 14 and height 5, 
seemed an adequate choice. 



40 



«- 



probability 
.1.0 



.0.* 



DETECTION CHARACTERISTIC CURVES FOR VARIOUS SIZES 
OF THE BASIC NEIGHBORHOOD 




signal li 
number of &L 



0.4 



0.8 



L.2 



1.6 



l.J 



2.0 



figure 18 



41 



1.0 
50% detection 

signal . NUMBER OF GRID-POINTS IS THE NEIGHBORHOOD 



SENSITIVITY AS A FUNCTIOK.OF THE 



0.9 



0.1 



tRt 



■sr 



60 



70 



00 



£igure 19 



0.8 
signal 

cor esponding 

to 50£ 

detection 



0.7 



8tS — 



SENSITIVITY AS A FUNCTION OF THE CUTOFF 
OH TOE SECOND DIFFERENCES 



i-o 

figure 20 



cutoff od the 2 



nd 



differences jji number of i L 
2,0 



42 

Ail numerical result*, in the remaining of the thesis, are based 
on a basic neighborhood containing 70 grld-*pouits. 

2) Next, we vary the cutoff on the second differences. The sensitivity, 
defined In exactly the same manner as above, shows s fist extremum for 
a cutoff around 1.2 standard deviation (figure 20 )* WithjL ■ 1.2 v.u.» 
the best we can approach this cutoff, with the digitisation of the inten- 
sitieSt is by using a threshold of 1 v.u.. 

The resulting detection characteristic for the optimal choice of 
parameters is plotted in figure ; it has the usual ly error for a 

zero-signal and 50fr detection occurs for a step? 

h m 0.56 v.u. 



This fixes the threshold on P to 6 p u lfi# 



II) Effects of the introduction of a condition on the function S 

The function S defined on page 37 can be used to discriminate the 

center extremum of F . froo its satellites. 

step 

Both .ji t tin: <-djMr and ar. t\u- satellites , we computed the probabilities 

that F be greater than 8_ and S be smaller than some threshold 

step F fitep 

Figure 21 plots those probabilities as a function of the signal, for 
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AS A FUNCTION OF THE SIGNAL, FOR VARIOUS CUTOFFS ON S 




figure 2L 
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various value* of Q • ( g has been fitted in each cane to get 1 / of 
error for a zero-signal) . 

For 0- ■ 10 , the decrease in sensitivity becomes too great for 
S 

a line-verifier. Down to 0* - 14, this decrease is negligible. But then, 
the probability of error by detection of the satellites has an upper bound 
of 0.2, which is large. 

Nonetheless we used a condition on S, as it takes no time to compute 
and it does perform discrimination for a whole range of signals, i.e. 
those ^2.8 v.u. . 

Roc-ark : more thorough investigation of this condition on S were carried 
out. It seemed to show that no detection system, even with different 
sensitivity requirements, could use it alone. Reducing the error enough 
involves reducing the probability of detection too much. Another alter- 
native which we would consider, if we were to build a general purpose 
detection system, is : look for the zero-crossings of the function S 
where L and R are both greater than some threshold. 
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2) The global procedure for the line-verifier 

Between the two points given as Si 

passible extremities of an edge, 25 

intensity profiles are taken, grouped 

by bands of 5 (figure 22)* The functions 

F a and S are computed on each band 
step T 

and the cutoff points arc stored with 
the fiien of £ recorded . 

The next step is to find a good vertical 
alignment of cutoff points with the same 



fign of F 



step 
points arc extreroa of F 



te that the cutoff 
tep 



edge 




figure 21 
along a band, so that we are left with very 

few points at this stage - from 1 to k per band depending on the state 

of the surface- ; "vertical linking" can then be very fast; usually 

the number of possible lines is just one, and the localization is precise 

(see figure 23 which shows a typical distribution of cutoff points). 



The search for an approximate vertical alignment is done as follows: 
we consider In turn various directions within the angular uncertainty 
of the edge. The cutoff points are projected along each direction, until 
at least 4 of them, each on a different band, yield approximately the 
flame direction- 
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figure 23 
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Let us evaluate an upper bound of the probability that an edge 
following the satellite extreroa be detected. Hie probability for a 
parasite extremal point on a band to appear is, as we saw, at most 0.2 
(with 6- e 14)* Aaaume that about 3 consecutive pointa on a band 
have that same probability of passing the cutoffe. Then the global 
probability of detection of the 'wrong' line is: 

2,m-3 *0.2 6 = 0.024 

At the global stage, and with the surface imperfections, this is too 
Large. So we do the following; note that lines along parasite cxtrcma 
follow pointa where F has a sign opposite to the sign on the edge. 

At the global stage, we process separately the points where 9 is 

positive and the points where it is negative; when each processing 
yields us lines, we compute, for each line, the sum of the values 
of F along it. For the real edge, this sum is largest (actually 

it is about twice the others). This is a very reliable statistic because 
it is global. This additional work however is necessary only when 
discrimination by a condition on S has failed. 

In order to evaluate the performance of the global procedure - 
with Gaussian noise only- we used simulation. We generated steps of 
various amplitude with a Gaussian noise superimposed. For each given 
amplitude, 1000 such edges were generated and processed by the line- 
verifier equipped with the set of optimal parameters, and the number 
of successes recorded. We thus obtained an approximation to the global 
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detection characteristic <figure2£ ), and the following result! 

With a probability of error of 0-3% on a flat 

distribution, 50/£ detection occurs for a step 

amplitude of 

1 v.u. 



Remark : co laprove localisation, whenever wc find ft points approximately 
vertically aligned we do not scop, using them to define the line, but 
we pick up all points near enough to this first approximation of the 
edge, and try to fit a line to them; wc then throw out every point 
too remote fron this second definition of the line and check wether 
we are left with enough points i-e* at least ft, all on different bands* 



3) Roofs 

The overall procedure is the same 
except for a different function F. Indeed 
figure 25 shows a profile and the corres- 
ponding second differences. A cutoff on 
the second differences will give, in an 
area containing a roof, a single vertical 
strip of all positive or all negative points 



profile 




econd 
differences 
















figure 25 
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So we replace P . by F .» Che difference between the number of posi- 
* step * roof r 

tive points and the number of negative points within a rectangular neigh- 
borhood of properly chosen size* The local predicate will simply be based 

on large extrema of F £ » 
* roof 

If the second differences are computed with an interval *4 , they 
are non-zero on a width 2 A, for an idealized roof. We chose a rectan* 

gular neighborhood of height 5 and width 2(2 A ) - £ a • 

3 3 

The definition of a proper cutoff on F - can be done as follows: 

a flat noisy intensity distribution la generated, with a given standard 

deviation. Using the same cutoff of 1 v*u. on the aecond differences as 

we did for a step* we applied the whole line-verification process for 

roofs, with a given cutoff on F f - The operation is repeated a great 

number of times (~5000) and the number of wrong decisions (yea) recorded. 

This is repeated for several cutoffs on F , until one Is found which 
y roof 

gives us at most L error in a 1000- 

In fact, this procedure has a limited range of efficiency. Indeed 
the height of the peak of the second differences varies, for a fl of 8 
(which for geometrical reasons is about maximal) from average values 
of 0.6 v.u. to raaximals of 2 v.u. ; clearly there is a whole range of 
roofs which wa would not see. In fact, detection for those small values 
of the curvature is very difficult, because there are some flat surfaces 
on which the curvature of the intensity surface is as large as on an edge, 
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(for example the translucent plastic cubes)! so that there is no way of 
distinguishing the two. Detection then should be made by another type 
of analysis; I.e. the analysis of shape from shading of B.Horn (Horn 1970) 
will not now handle this but could reasonably be expected to extend to 
this problem. 



M Edge-effects 

The procedure is the same && for roofs, with a different size of 
basic rectangular neighborhood. Figure 26 shows the distribution of the 
second differences cutoff points for a typical edge-effect; the cutoffs 
on the second differences are respectively 2, 3 and 4 v.u. for a,b,c. 
This suggests a cutoff of 3 and a neighborhood of width 4. 

Definition of a cutoff on F „ is determined as in the case of 

effect 

roofs; by global simulation, the criterion being to make low enough 
the probability of error on a fiat distribution. 



*.- 
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SECOND DIFFEREKCES CUTOFF POINTS ON AN EDGE- EFFECT 



FOR 
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5) Experiments with the line-verif ier 

To test the line-verifier , we started with cubes having relatively 
good surfaces (scene 1: figure 27 )« I.e. quite uniform and with little 
reflectivity. 

Plrat we looked for a proper value of the threshold on F by trying 
the verifier on faces, starting with the value of Q computed with 
Gaussian noise. As expected, we had to raise Q * but only from 16 *the 
computed value- to 18. Then, out of about 30 tries, no failure was recor- 
ded. 

We then tried the verifier on the edges, modifying the lighting in order 
to get a wide range of different conditions- Failures occurred only by 
carefully adjusting the intensity on both sides of the edge, using the 
information returned by the verifier as to which side was darker; we 
could not toll otherwise as typically edges were detected such that, on 
their profiles ^s displayed on the scope, nothing was visible by eye. 
Actually the range of positions of a cube where failures occur is very 
small (translation of 1 ran in 50 mm) and we could only find a position 
where failures occurred only half of the time. The localization was good 
and it was insensitive to displacements of the edge from its expected 
position within the ranges which we expected; i.e. the extremities of the 
edge can be within £10 points from the expected. 

Very dim reflections of an edge against another aurface were detected 
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as edge*. 

To test the limits of functioning of Che verifier, we set up two 
other scenes with very bad objects (scenes 2 and 3; figure 28 and 29). 
When keeping the same constants as in scene 1> ve made errors most 
of the time on plane surfaces. Then, instead of raising 9 , which 
would have diminished our sensitivity, we used 10 bands instead of 5 t 
and required at least 8 of them to carry a cutoff point. Then we could 
record no failures on flat surfaces, although some of them practically 
showed texture; end-grain and wood-lines (note that the procedure ignores 
every line less than 3 points wide)* The sensitivity on edges was quite 
similar to that described for scene 1. 

Rounded edges as in scene 2 were successfully detected. Trying the 
verifier flfigw an actual «dgc docs not cause errors; i.e. the answer 
is no . Roofs and edge-effects are detected as such (roofs appear essen- 
tially with the translucent plastic cubes). 

Ve think that the line-verifier should adapt its constants depen- 
ding on data made available by the higher level procedures; like the 
space probably available for taking cross-sections without overlapping 
other edges, corners etc.; one could possibly use trapezoidal neighbor* 
hoods when one looks near corners. Data about the state of the surfaces 
also could be used to fix the best values of the parameters for each 
particular verification* 

The computation time is about 1/2 second, (the program is in MIDAS). 
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CONCLUSION 

We have proposed * boundary detection wet hod which proved 
valuable for line verification. Its noise discrimination is the 
result of three principles; i.e. it uses summation of valuea of 
a non*lineai; function function of the intensities, and this function 
accounts for the geometry of edges* 

It can detect an intensity step of 1 v.u. = 0.?J£ with 50% 
success. There are theoretically certain i^£££ of edges for which 
it fails (certain roots and mixed-type edges) but their occurrence ie 
rare and we were not able to find one in our experiments. 

The most interesting property of the verifier is its very good 
filtering of surface irregularities, as shown by the success of 
experiments with practically textured surfaces* The speed of the 
verifier is satisfactory; a»o*t of the time is spent in scanning. 

On defect is that it will have trouble distinguishing parallel 
edges less than 16 grid-points apart (twice the interval for the 
second differences) which in usual conditions is i.6^ of the scene. 
The trouble thus Incurred Is linked to the relatively low resolution 
of the vldlssector and the fact that one cannot escape a trade-off 
between sensitivity and observed space. 
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The method could certainly be implemented as a general purpose 
line-finder, trading excellent sensitivity for time economy by using 
a looser grid and making summation over smaller neighborhoods. It 
would of course retain its insensltivity to surface defects which is 
so essential for a practical edge-detector . 
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APPENDIX I 



Gradient at image for constant intensity at object 




figure 30 
The reflected intensity at the surface of the object is J . Let 

M be a point on the object and dA a surface element on the object 



surrounding H; then 



Image of dA ; 



JM " 



¥ 



w 



11-*=*! 



dA 



the light reflected and if dA t is the 



d ; distance aperture- ira^e 



d : distance aperture-object 



If r is the vector joining M to the center of the aperture, the light 
entering the aperture and issuing from the object element dA is: 



iL _ J (dA 



A , r 



r 



solid angle defined by M and 
the aperture A « 



The image Intensity is thus: 
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Using Che thin lens relation; 



d 



+ 1 - 1_ 



ve get: 



Thus: 
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Let dx be an inf initeslnial vector on the object surface; to a second 



order approximation, we will compute the logarithmic Intensity variation 
at the image, *% for a displacement dx of the object point. 
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We will calculate the separate terms: 
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vector normal to the aperture. 
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Given the orientation of n_ and r & (Sec figure ), we have: 



d = -n . r and, 

o a a 



S(d - O.JtL . if ♦ dx 

o o a 



Thus i rn 

1" 



2 ^ a .d> . ^l"** + a f t&l j£ 



d. _{ 

J, 






and if sT is the distance from the optical axis to W; 



■V A * F a * d * 



V - <t 



And as IT • 3T = 
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- {4," a 4- x). dx 



Thus: 
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The first order term in Ji cancels- I£ we write 

j. 

ii. n. * is. 



» J = J.s 
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To a first order approximation, — -*• * * 

Thus S* - I^S and gradients at the image and at the object 

are the sane. 

We obtain a typical magnitude of the gradient at the image for a cons* 
tant Intensity at the object, by taking; 

IdJI- I" E - 10" 

Itfl- 3" d o - 50" 

Roughly; 

J. 2 5oo 
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APPENDIX II 



Computation or detection charactitriRik .urvL^ 




1) Consider the signal of figure 31* d(X) 

We sample K points where Che amplitude is fl 

at each such point X, d{X) is normally 

distributed with mean T And variance I. 

We put a two-aided cutoff at 9. on those 

K values; let 

n be the number of points whore d (X)> 
n^ the number of points where d(X)<-0 rf 

We will evaluate 

^ T ^ m probability that (n + - n_) = k 



figure 31 




normal curve of error 



The tables of the normal distribu- 
tion give us the probabilities p^_ (resp. p f ) 
that at a given point X where the mean 
d(X) be >0 d (reap. <- 6^)- (figure 32 



Let 






P ° - probability chat -8.^ J(x)^*-8, 

= i - ( p t + * p; ) 

We will have (K - n + - n_) points where 

The probability Tr (fc) will be a sum of trinomial terms > 



figure 32 
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,.,-i(.>;)"T.?)i%>"< f ;)' 



with n_ * n, - k 

2) Nov consider D2(X) for a step. 
Wc sample K points right of C where 
the signal is ? . and K points left of C where it is -T. 

D2ff) 

r- fc+- n -> rlght ■ (%■ Una 

- k - k* 

* nd S - k + k' 

figure 33 
Then the probability that 

(F|>^. and (S|<8 S at C 1b: 

3) The computation of the similar probability at A (parasite extremum) 
Is given by the same formula except that In the right half the proba- 
bilities are \ Instead of 7r . 




PA - 



L_ *ik)\&: 






This was programmed with a little different organization in order co 
keep the computation time from getting too large. 
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